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SYNESTHESIA,  A  FORM  OF  PERCEPTION 

BY  RAYMOND  H.  WHEELER  AND  THOMAS  D.  CUTSFORTH 

University  of  Oregon 

This  investigation  aims  to  answer  the  following  questions: 
(i)  Are  the  secondary  processes,  so  called,  in  the  phenomenon 
of  synsesthesia,  incidental  or  essential  in  the  mental  life  of 
the  synaesthetic  individual?  (2)  What  is  the  behavior  of 
attention  between  the  two  associated  processes  in  any  given 
example  of  synaesthesia  ? 

The  experimental  method  here  pursued  was  as  simple 
as  possible  and  the  results  have  been  obtained  throughout 
from  introspective  data.  While  only  one  case  of  synaesthesia 
has  been  available  for  this  study  it  is  believed  that  an  in¬ 
tensive  and  thorough  analysis  of  even  one  genuine  case 
should  throw  some  light  upon  the  nature  of  the  problems 
involved.  Trained  synaesthetic  reagents  are  sufficiently  rare 
to  warrant  the  report  of  a  single  instance. 

Our  reagent  was  the  junior  author,  a  graduate  student 
in  psychology  and  an  introspector  of  several  years’  experience. 
He  lost  his  sight  at  the  age  of  eleven  and  has  noticed  his 
synaesthesia  ever  since  he  has  been  able  to  remember,  which 
was  long  prior  to  his  blindness.  A  detailed  analysis  of  his 
case,  together  with  a  history  of  the  literature  on  synaesthesia, 
has  been  published  elsewhere.^ 

In  the  experimentation  the  observer  {A)  was  instructed 
to  focus  his  attention  upon  some  reading  matter  which  was 
presented  him.  While  he  was  thus  engaged  in  reading,  the 
experimenter  stimulated  him  with  various  sounds,  tactual 
and  other  stimuli.  In  a  series  of  check  experiments  A  was 
asked  to  anticipate  the  sound  or  the  contact. 

The  following  are  a  few  examples  of  a  vast  amount  of 
introspective  data  which  have  been  obtained,  alw^ays  under 
the  same  conditions,  over  a  period  of  two  academic  years. 

^  ‘  The  Synaesthesia  of  a  Blind  Subject,’  University  of  Oregon  Publications,  i. 
No.  5,  1920. 
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I.  Stimulus:  The  tapping  of  a  bell  with  instructions  to 
A  to  anticipate  the  sound.  “Tried  to  anticipate  the  sound 
in  terms  of  leaning  my  head  in  the  direction  of  the  experi¬ 
menter;  called  up  detached  visual  images  of  familiar  sounds; 
said  ‘sound’  to  myself  several  times;  found  myself  totally 
unable  to  obtain  auditory  imagery  of  any  sound  for  all  I 
could  obtain  was  a  series  of  visualized  sounds.  When  the 
bell  was  tapped  the  first  experience  I  had  was  a  visual  image 
of  a  small,  silvery  cloud;  could  not  possibly  have  said  that 
it  was  an  auditory  stimulus  until  the  visual  image  floated 
into  my  field  of  vision  from  the  direction  of  the  experimenter. 
All  this  happened  very  quickly,  with  exceedingly  rapid  shifts 
of  attention.  Then  by  means  of  eye-movement  I  shifted 
my  attention  vigorously  in  the  direction  of  the  stimulus. 
Then  for  an  instant  I  thought  I  heard  the  sound  itself  as 
such  but  I  noticed  definitely  that  it  was  non-focal;  the 
visual  cloud  momentarily  vanished  but  far  quicker  than  it 
takes  to  say  it,  it  reappeared  and  I  found  that  with  the 
reappearance  I  was  again  aware  of  the  sound.  In  attending 
to  the  sound  I  find  myself  focused  upon  visual  rather  than 
upon  auditory  qualities.  I  tried  it  again,  while  the  sound 
was  still  lingering;  this  time  I  said  ‘sound’  in  vocal-motor 
fashion  and  had  intensive  strains  in  my  neck  of  leaning 
toward  the  source  of  the  stimulus.  Here  I  thought  I  suc¬ 
ceeded  in  attending  to  the  sound  itself,  focally,  but  as  before, 
discovered  that  what  meant  the  sound  to  me  was  in  reality 
this  persisting,  silvery,  visual  image.  I  was  conscious  of  the 
metallic,  mellow  ring  of  the  bell  in  terms  of  the  silvery  quality 
of  the  visual  image;  the  intensity  of  the  bell-sound  was  the 
brightness  of  the  visual  image;  the  changing  quality  and 
intensity  of  the  bell  came  to  me  only  in  terms  of  changing 
quality  and  brightness  of  the  silvery  image.  At  no  time 
was  I  getting  away  from  visual  qualities;  they  followed  me 
no  matter  where  I  turned  or  what  I  did.  The  sound  was 
present  to  consciousness  but  never  with  sufficient  distinctness 
to  describe.  It  was  merely  ‘something’  and  was  always 
a  ‘step  behind’  attention.  I  could  tell  you  when  the  sound 
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Stopped  and  when  it  began  or  when  it  changed,  but  always 
in  terms  of  its  visual  associate.” 

2.  Stimulus:  prolonged  blast  upon  a  small,  shrill  whistle. 
A  was  instructed  to  do  his  best  to  attend  to  the  sound  quali¬ 
ties  as  such.  “I  find  that  I  can  attend  to  the  sound  as 
long  as  I  do  not  attempt  to  analyze  it;  all  the  sound  of 
which  I  am  aware  is  an  undifferentiated  ‘something’;  it  may 
be  ‘raw’  sound;  it  is  meaningless;  I  interpret  the  experience 
as  sound  in  terms  of  the  vocal-motor  image,  ‘sound,’  or 
my  attention  shifts  to  motor  relaxation  and  I  find  myself 
merely  responding  to  a  ‘sound’  situation.  I  simply  cannot 
focalize  the  sound  as  such  in  the  absence  of  visual  imagery; 
my  alertness  to  the  sound  invariably  appears  in  terms  of 
its  visual  associate.  All  of  the  above  I  have  interpreted 
from  what  actually  happened.  The  instant  the  stimulus  was 
given  I  became  conscious  of  something;  but  this  something 
was  at  once  followed  by  a  focusing  of  visual  attention  upon 
color  and  brightness.  (Then  a  further  attempt  to  shift  from 
visual  to  auditory  qualities  resulted  only  in  shifting'  from 
one  visual  quality  to  another.)  As  I  tried,  with  a  vocal- 
motor  aufgabe  to  single  out  auditory  qualities  I  found  myself 
attending  to  single  visual  qualities;  the  intensity  of  the 
sound  was  present  in  terms  of  the  sharpness  and  brightness 
of  the  visual  image;  a  quality  of  the  whiteness  of  the  visual 
cloud  meant  the  timbre  of  the  sound;  upon  each  attempt 
to  attend  to  auditory  qualities  I  found  that  the  sound  itself 
lingered  in  consciousness  as  an  undifferentiated  bit  of  aware¬ 
ness;  the  combination  of  sound  plus  visual  image  constituted 
the  sound  of  a  certain  pitch,  quality  and  intensity.  I  could 
attend  to  the  sound  itself  as  long  as  I  was  not  listening 
to  anything  in  particular  and  did  not  try  to  label  the  sound.” 

3.  Stimulus:  A  piece  of  round,  cold  metal  applied  to 
A’^  left  temple  while  he  was  absorbed  in  reading.  A  jumped 
when  the  stimulus  was  applied.  “Here  the  sensation  of 
coldness  appeared,  visualized  in  color  upon  my  temple, 
together  with  a  widespread  motor  response  of  jumping. 
The  motor  reaction  came  before  I  consciously  identified  the 
sensation  as  coldness.  At  first  I  was  conscious  of  something 
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hitting  me;  at  this  juncture  I  could  not  have  said  that  it 
was  cold;  neither,  at  this  time,  was  the  sensation  localized. 
Then  the  sensation  became  localized  before  it  was  felt  as 
cold;  this  consisted  of  tendencies  to  visualize  a  halo  of 
white  light  about  my  temple;  the  localization  first  appeared 
with  the  tendency  for  my  line  of  regard  to  shift  to  that 
region  of  my  head.  Then,  with  the  becoming  conscious  of 
whiteness  as  such  came  the  meaning,  ‘coldness.’  I  subse¬ 
quently  noticed  that  my  consciousness  of  something  hitting 
me  came  in  terms  of  a  lingering  awareness  of  my  motor 
response.” 

(Further  tests  revealed  a  foreshortening  in  the  procedure 
just  described.  Tactual  sensations  began  to  appear  not  as 
‘mere  somethings’  at  the  outset  but  ‘something  localized.’ 
Here  it  was  found  that  the  visual  process  appeared  with 
the  original  sensation  and  gave  to  it  its  localization.  This 
foreshortening  appeared  as  a  rule  when  at  the  time  of  stimu¬ 
lation  A  was  anticipating  what  was  coming.) 

Interpretation  of  Introspective  Data 

Introspections  on  acts  of  perceiving  are  extremely  difficult. 
The  mental  processes  take  place  with  such  rapidity  that  a 
tremendous  amount  of  practice  is  necessary  in  order  to 
cultivate  an  ability  to  note  the  processes  just  as  they  appear 
without  unwittingly  adding  to  them  or  leaving  some  im¬ 
portant  but  only  momentary  shift  of  attention  unnoticed. 
Further,  it  is  impossible  to  separate  interpretation  from 
description  of  ‘immediate  content.’  Description  of  imme¬ 
diate  content  is  nothing  but  an  interpretation  reduced  to 
its  finest  possible  stage  of  analysis.  Immediate  content,  as 
will  be  noticed  from  the  above  introspections,  is  something 
indescribable. 

We  find  it  necessary  to  distinguish  between  ‘being  con¬ 
scious’  and  ‘being  conscious  0/’  something.  The  first  means 
that  a  mental  activity  is  existing  or  taking  place;  the  second 
means  that  two  seriated  mental  activities  are  existing  and 
that  as  a  result  of  the  temporal  relations  of  these  two,  the 
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second  labels  or  identifies  the  first.  In  other  words,  in  the 
second  instance,  there  exists  a  cognitive  function — an  act 
of  recognizing  or  of  interpreting  that  ‘something’  of  which 
one  is  conscious. 

A’s  so-called  awareness  of  sounds,  pressure  sensations  and 
other  non-visual  processes  are  not  examples  of  being  conscious 
of;  but  rather,  they  approach  as  nearly  as  possible  the 
condition  of  actual  ‘raw’  sensation — meaningless,  unidenti¬ 
fied,  uninterpreted,  ‘raw’  experiences.  They  are  ‘bits’  of 
consciousness  and  that  is  all.  They  constitute  awareness  of 
‘something,’  which  in  the  absence  of  further  mental  contents 
practically  amounts  to  an  awareness  of  nothing  describable. 
When  A  refers  to  these  experiences  he  is  forced  to  say: 
“There  was  an  experience  there  but  I  cannot  describe  it,” 
The  instant  he  is  able  to  say  “I  was  conscious  of  a  sound, 
something  sharp,  something  localized,  something  blunt, 
something  loud,”  etc.,  the  experience  which  he  previously 
described  as  merely  ‘something’  has  developed  beyond  the 
stage  of  sensation  and  into  the  stage  of  perception.  This  de¬ 
velopment  in  his  case  necessitates  the  use  of  visual  synsesthetic 
images.  The  change  from  sensation  to  perception  is  brought 
about  by  means  of  the  functioning  of  a  stereotyped  visual 
associate.  As  long  as  this  visual  associate  fails  to  develop, 
or  when,  after  long  practice,  the  reagent  is  able  to  ignore 
the  visual  associate,  a  sound  is  neither  a  sound  of  an  object 
nor  of  a  quality;  a  pressure  is  neither  the  pressure  of  an 
object  nor  of  a  quality;  a  cold  is  neither  a  cold  of  an  object 
nor  of  a  quality.  Without  the  visual  associate,  moreover, 
these  sensations  are  not  localized,  but  the  instant  the  visual 
associate  appears  localization  appears.  Could  there  be 
more  tangible  evidence  that  synsesthesis  in  this  case  is  not 
a  freak  phenomenon  functionally  but  is  A’s  method  of 
perceiving  i 

A’s  procedure  in  perceiving  does  not  differ,  functionally, 
from  perceptions  in  the  asynsesthetic  individual.  The  only 
difference  which  we  can  find  lies  in  the  stereotyped  nature 
of  the  associated  imagery  and  in  the  fact  that  it  is  always 
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derived  from  the  visual  modality.  The  asynaesthetic  indi¬ 
vidual  apparently  hears  sounds  directly,  or  feels  contacts 
directly,  because  such  associates  as  appear  in  connection  with 
the  original  sensation  blend  with  the  latter  while  do  not. 

The  visual  feature  of  y^’s  process  of  perceiving  may  enter 
consciousness  previous  to  the  original  sensation  feature.  In 
such  instances  the  dissociated  visual  image  means  nothing 
or  symbolizes  nothing  until  the  primary  process  appears  in 
non-focal  consciousness  or  until  the  dissociated  image  leads 
to  further  visual  imagery  as  the  primary  sensation  would 
have  done  had  it  functioned  instead  of  the  detached  synaes- 
thetic  image.  Thus  the  detached  synaesthetic  image  means 
nothing  as  long  as  it  stands  alone  in  consciousness  or  as 
long  as  it,  alone,  is  attended  to.  Neither  the  primary  nor 
the  secondary  process,  then,  can  mean  anything  until  it  is 
‘identified’  by  its  contextual  associate  or  a  proper  substitute. 
Should  the  detached  visual  image  appear  in  consciousness 
first,  only  the  momentary  presence  of  the  sensory  process 
in  non-focal  consciousness  is  necessary  to  give  meaning  to 
the  visual  accompaniment. 

As  far  as  the  development  of  meaning  is  concerned,  the 
two  processes — the  primary  and  the  secondary — are  reversi¬ 
ble.  Either  one  will  ‘identify’  the  other.  The  second  to 
appear  ‘identifies’  the  first.  The  shift  of  attention  from 
one  to  the  other  constitutes  a  process-aspect  of  the  experience 
and  is  the  essential  feature  in  the  act  of  perceiving.  Without 
this  shift  of  attention  either  the  primary  or  the  secondary 
process  is  detached  from  its  associate  and  means  nothing. 
By  means  of  this  shift  of  attention  the  mere  condition  of 
‘being  conscious’  develops  to  the  condition  of  ‘being  conscious 
of’  something.  The  cognitive  function  of  mental  activity 
so  far  as  the  act  of  perceiving  is  concerned,  lies  in  part  in 
this  tendency  for  an  antecedent  process  to  merge  into  a 
subsequent  process  or  for  the  second  to  issue  from  or  develop 
from  the  first. 

In  general,  then,  visual  synsesthetic  phenomena  make 
it  possible  for  him  to  become  conscious  of  things.  Without 
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this  imagery  his  world  would  be  a  mass  of  undifferentiated 
and  consciously  meaningless  jumbles  of  sensation  until  he 
found  some  other  means  by  which  he  could  identify  this 
‘raw,’  non-visual  consciousness.  It  is  his  visual  synsesthetic 
imagery  which  renders  his  mental  life  cognitive  in  function. 
Visual  imagery  for  him  is  the  basis  of  knowing.  It  is  the 
basis  of  all  forms  of  interpretation. 

Without  this  visual  imagery  A’s  mental  life  would  un¬ 
doubtedly  lack  the  higher  intellectual  processes.  He  would 
be  driven  to  interpret  sensory  experiences  as  we  presume 
do  the  animals,  namely,  in  terms  of  overt  motor  responses. 
Undoubtedly  animals  identify  objects  not  in  terms  of  con¬ 
scious  meanings,  as  we  know  them,  but  in  terms  of  instinctive 
and  habitual  motor  responses.  The  motor  response  issuing 
from  a  stimulus  is  meaning  in  animal  behavior.  The  ob¬ 
ject  is  not  consciously  interpreted  or  analyzed.  Otherwise 
the  animal  would  possess  cognitive  functions,  evidence  of 
which  is  lacking. 

While  our  experiments  have  been  exceedingly  simple, 
we  believe  that  the  results  are  far-reaching  in  their  implica¬ 
tions.  For  observer  A  sensations  have  no  attributes — no 
quality,  no  intensity,  no  duration,  no  clearance,  as  such. 
Attributes  are  meanings.  In  themselves  they  are  perceptions 
whose  minimum  simplicity  consists  of  (i)  an  undifferentaited 
and  indescribable  experience  and  (2)  a  stereotyped  synses- 
thetic  image.  There  must  be  a  shift  of  attention  from  the 
one  and  toward  the  other;  the  stereotyped  image  must  behave 
in  a  sufficiently  complex  fashion  to  provide  for  analysis;  there 
must  be  two  features  of  the  total  experience,  the  process  to 
identify  and  the  identifying  process. 

Further,  these  results  lead  one  to  very  seriously  doubt 
that  a  ‘one-level’  consciousness  can  exist,  or  that  a  ‘one- 
level’  attention  can  exist.  We  note  that  A  is  able  to  report 
the  existence  of  sensation  in  his  mental  life  at  all  only  by 
virtue  of  a  shift  of  attention  from  it  to  the  stereotyped 
process.  When  this  shift  is  not  present  the  existence  of 
the  sensation  can  be  doubted.  At  least,  in  the  nature  of 
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things,  the  observer  could  never  know  that  it  existed.  Evi¬ 
dence  points  to  the  fact  that  attention,  like  attributes,  is 
a  functional  and  not  a  structural  phenomenon,  whose  mini¬ 
mum  simplicity  consists  of  a  shift  from  one  datum  to  another, 
the  second  of  which  must  differ  in  some  respect  from  the 
first.  This  means  that  attention  is  not  ‘clearness’  but  a 
phenomenon  of  meaning,  i.e.,  that  form  of  distribution  or 
change  in  distribution  of  mental  contents  which  constitutes 
meaning. 

Again,  we  find  in  this  investigation  that  localization  does 
not  exist  for  A  a.s  a.  feature  inherent  in  sensation,  nor  is  it 
an  unanalyzable  phenomenon.  It,  again,  is  a  product  of 
change  and  growth,  which,  under  the  proper  experimental 
conditions  and  with  sufficient  introspective  experience,  re¬ 
duces  itself  to  the  behavior  and  functioning  of  synsesthetic 
images.  We  are  led  to  believe,  that,  in  general,  localization 
is  not  a  datum  sui  generis. 

Finally,  this  and  attending  studies  on  synsesthesia  point 
very  definitely  to  the  conclusion  that  there  is  no  datum  of 
consciousness  which  can  rightfully  be  called  ‘unanalyzable’ 
or  ‘sui  generis.’  The  unanalyzability  of  our  simpler  experi¬ 
ences,  is,  without  doubt,  a  product  of  syncopation,  blending,  at¬ 
tenuation.  Had  we  analyzed  more  cases  of  synaesthesia,  a  few 
more  cases  of  total  amnesia  and  some  very  careful  records  of 
experiences  by  trained  introspectors  while  going  under  and 
coming  out  from  the  influences  of  an  anaesthetic,  we  would  un¬ 
doubtedly  find  that  many  so-called  ‘  elemental  ’  experiences 
are  exceedingly  complex  in  their  nature. 

Conclusions 

1.  Colored  hearing  and  allied  synaesthetic  phenomena  of 
peripheral  origin  are  not,  in  our  reagent’s  case,  peculiar  or 
abnormal  mental  activities.  Rather,  they  are  his  normal  and 
usual  method  of  perceiving. 

2.  Without  the  secondary  process,  the  stereotyped  visual 
image,  our  reagent  cannot  perceive. 

3.  The  sensory  component,  the  primary  process,  is  in- 
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describable.  The  best  that  can  be  said  concerning  the 
sensory  component  is  that  it  Is  ‘something.’ 

4.  These  facts  hold  for  every  sense  modality. 

5.  In  our  reagent’s  case  attributes  of  ‘elementary’  expe¬ 
riences  exist  only  when  describable.  For  him  sensations 
have  no  attributes.  Such  as  appear  to  be  attributes  are  data 
of  consciousness  only  In  terms  of  the  behavior  of  visual  synses- 
thetic  images. 

6.  Attributes,  so  called,  In  our  reagent’s  case,  are  mean¬ 
ings. 

7.  While  the  secondary  processes  in  our  reagent’s 
synsesthetic  phenomena  appear  to  have  attributes,  evidence 
tends  to  show  that  these  likewise  are  cognitive  processes 
and  not  sui  generis  contents. 

8.  These  results  point  to  the  conclusion  that  the  simplest 
possible  mental  process,  or  at  least  the  simplest  describable 
mental  process  Is  a  dual  phenomenon  implying  an  attention 
shift.  Because  of  this  attention  shift,  states,  attributes  and 
other  structural  features  of  mental  life  appear  as  interpre¬ 
tations  and  only  as  interpretations.  They  are  arbitrary. 

9.  The  theoretical  considerations  to  which  these  facts 
ultimately  lead  are  not  new.  Here  we  are  confronted  with 
the  long  famous  difficulty  of  act  and  content,  with  the 
problem  of  ‘immediate  content’  and  other  perplexing  psy¬ 
chological  difficulties.  A  continued  discussion  is  reserved 
for  a  future  paper. 

10.  If  the  results  of  this  Investigation  are  typical  we 
may  conclude  that  synaesthesis  is  a  cognitive  process,  a 
phenomenon  of  meaning,  and  that  the  secondary  Image  is 
essential.  By  means  of  Its  functioning,  sensation  develops 
to  perception.  Before  this  perception  is  complete  there 
must  be  an  attention  shift  from  primary  to  secondary  process 
or  from  secondary  to  primary.  The  sensory  component  and 
the  Image  component  are  necessary  but  their  order  of  appear¬ 
ance  may  vary. 
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